inn 



US 20030174884A1 

(19) United States 

(12) Patent Application Publication m Pub. No.: US 2003/0174884 Ai 

Levy et al. (43) Pub. Date: Sep, 18, 2003 



(54) REDUCING HALOS IN SPATIALLY 
DEPENDENT GAMUT MAPPING 

(76) Inventors: Avraham Levy, Kiryat Tivon (IL); 

Doron Shaked, Sunnyvale, CA (US) 

Correspondence Address: 
HEWLETT-PACKARD COMPANY 
Intellectual Property Administration 
P.O. Box 272400 

Fort Collins, CO 80527-2400 (US) 

(21) Appl. No.: 10/096,303 

(22) Filed: Mar. 13, 2002 

Publication Classification 

(51) Int. CI. 7 G06K 9/00 

(52) U.S.CI 382/167 



(57) ABSTRACT 

A method and apparatus for color image processing using 
gamut mapping reduces halo artifacts by correcting terms in 
a gamut mapping algorithm. The color image may be 
represented by f, the in gamut image by g, the target gamut 
by C, and the gamut constraint by c. The method for 
reducing halo artifacts includes two correction steps. First a 
color distance term in the gamut mapping algorithm is 
corrected. Second, a distance measure of an image gradient 
in the gamut mapping algorithm is corrected. The first 
correcting step comprises computing a function u=pro- 
ject c (f)- The second correcting step comprises computing a 
scaled down function for f. Next, a function g(x,y) is 
determined that minimizes a functional comprising the color 
distance term and the image gradient term. The solution may 
be determined by iteration using a gradient descent opera- 
tion by first initializing g 0 =P r °j e ct c (j : ), and then performing 
one or more iteration steps to compute g(x,y). 
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REDUCING HALOS IN SPATIALLY DEPENDENT 
GAMUT MAPPING 

TECHNICAL FIELD 

[0001] The technical field is color image processing using 
spatially dependent gamut mapping. 

BACKGROUND 

[0002] Gamut mapping is used to modify a representation 
of a color image to fit into a constrained color space of a 
given rendering medium. A laser-jet color printer that 
attempts to reproduce a color image on regular paper would 
have to map the photographed picture colors in a given color 
range, also known as the image "color gamut," into the given 
printer/page color gamut. Gamut mapping of an original 
color image may produce unwanted artifacts in the rendered 
image. One such artifact is referred to as a halo. Halo 
artifacts occur near edges of objects in the rendered image, 
and are a consequence of using spatially dependent gamut 
mapping algorithms to map an original color image onto a 
constrained color space. 

SUMMARY 

[0003] A method and apparatus for color image processing 
using gamut mapping reduces halo artifacts by correcting 
terms in a spatially dependent gamut mapping algorithm. 
The color image may be represented by f, an in gamut image 
by g, a general gamut volume by C, and a gamut constraint 
by c. The method for reducing halo artifacts includes two 
correction steps. First, a color distance term L2 in the gamut 
mapping algorithm is corrected. Second, a distance measure 
of an image gradient in the gamut mapping algorithm is 
corrected. The first correcting step comprises computing a 
function u=min(f,c). The second correcting step comprises 
computing a monotone increasing function J=S(/), such that 
the derivative of S is smaller than unity for high values off. 
Next, a function g(x,y) is determined that minimizes a 
functional comprising the color distance term and the image 
gradient-distance term. The solution may be determined by 
iteration using a gradient descent operation by first initial- 
izing g 0 «min(f,c) and then performing one or more iteration 
steps to compute g(x,y). 

[0004] The apparatus may comprise a suitably pro- 
grammed processor or other general purpose computer that 
receives an input image, processes the input image accord- 
ing to the corrected processing routines, and produces an 
output electrical signal capable of being rendered as a color 
image on a suitable rendering device such as a color laser 
printer, for example. 

[0005] The method may be embodied on a computer 
readable medium comprising routines for reducing halo 
artifacts during color image processing using gamut map- 
ping. The computer readable medium may be one of a hard 
disk, a floppy disk, or other magnetic storage, an optical 
storage device, or any other computer readable medium. 

DESCRIPTION OF THE DRAWINGS 

[0006] The detailed description will refer to the following 
drawings in which like numerals refer to like objects, and in 
which: 



[0007] FIGS. 1A-1C illustrate the effect of correcting a 
gamut mapping algorithm; 

[0008] FIG. 2 is a block diagram of an apparatus that uses 
the corrected gamut mapping algorithm; and 

[0009] FIG. 3 is a flowchart showing an operation of the 
gamut mapping algorithm, 

DETAILED DESCRIPTION 

[0010] A variational approach for color image gamut 
mapping is based on an image difference measure, which is 
a combination of two terms. The first term is a standard Lj 
distance measure, aimed at preserving the original colors of 
the color image. The second term is the distance measure 
of the image gradient, which preserves the original image 
variations. This variational approach of color image gamut 
mapping operates on each color channel, e.g., R, G, and B, 
separately, and hence can be presented as a one dimensional 
(ID) approach. 

[0011] Considering only one color channel, an image S 
can be represented by a positive, bounded and differentiable 
function, f(x,y), defined on a bounded domain Q. To project 
the representation into a restricted color gamut, which 
reduces to projecting into a line interval in the ID case, 
requires finding a positive and differentiable function g(x,y) 
that minimizes the functional: 



{ {k*{J -g)?dxdy + a [{V(k*(f-g))) 2 dxdy, 
Jn Jn 



[0012] subject to c 1 ^g(x,y)ic h , where c a and c h are con- 
stants that describes the ID target gamut restriction, k(x,y) 
is a smoothing kernel, and a is a parameter. This minimi- 
zation problem can be solved by an efficient quadratic 
programming (QP) iterative method. Quadratic program- 
ming methods are well know to those skilled in the art of 
color image reproduction. To simplify matters, and without 
loss of generality, the gamut constraint c may be treated as 
one sided and g(x,y)=c. 

[0013] The variational approach to color image reproduc- 
tion approach suffers from halo artifacts near image edges. 
Such halo artifacts are formed because there is no local 
restriction on the size of the projected image gradient. 

[0014] A ID formulation of the gamut mapping problem is 
used to illustrate a method and apparatus for reducing the 
halo artifacts. Considering the original image J 5 , and its 
corresponding color gamut, in those points where f(x,y) is 
larger than the constant c, the gamut constraint g(x,y)ic 
ensures that g(x,y) will be smaller than f(x,y). Therefore, the 
L^ term at such points has a large contribution to equation 
(1), and g(x,y) is strongly pulled toward the constraint value 
c. FIG. 1A shows this behavior. In FIG. 1A, c represents the 
gamut constraint (again, only one gamut constraint need be 
considered), f represents the original image, and g represents 
the in-gamut image. As can be seen at point 1 on f, an image 
edge occurs. The in gamut image g decreases in value as f 
decreases. When f returns to a constant value, g attempts to 
reach the value of f (i.e., g approaches c with a positive 
slope), but is constrained by the gamut constraint c. This 
behavior creates the halo phenomena near image edges. To 
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reduce this effect, the function k*f in the term is replaced 
with the function k* min(c,f). The corrected term, (k*g- 
k*min(c,f)) 2 , is smaller than the original term, (k*g-k* ff, 
at points where f(x,y)>c and hence the halo artifacts are 
reduced. The corrected formulation is: Find a positive and 
differentiable function g(x,y) that minimizes the functional: 



f ((Jt»mii</, c)-k*g)) 2 dxdy + a f\V(k*{f-g))] 2 dxdy< 



[0015] subject to g(x,y)^min(c(x,y), /(x,y)). 

[0016] The effect of replacing the function k*f in the 
term with the function k* min(c,f) can be seen in FIGS. 1A 
and IB. After the edge 1 is reached, the value of f decreases 
sharply to a new, approximately constant value. The value of 
g also decreases, but instead of attempting to reach the value 
of k*f as in FIG. 1A, which creates a strong slope due to the 
distance between g and its target, the new (and closer) target 
function k*min(c,f) causes g to increase at a much slower 
rate (smaller slope than shown in FIG. 1A) toward c as 
shown, thereby reducing halo effects. 

[0017] The above improvement reduces halo effects by 
altering the first term in equation (1). However, this 
improvement is not the only step that can be taken with 
respect to equation (1) to minimize halo artifacts. The 
derivative 1^ term may also be modified to reduce halo 
artifacts. For the sake of brevity the derivative term is 
here called the Sobolev term. Near sharp edges, where |V/| 
has high values, the Sobolev term causes |Vg| to have 
similarly high values. However if a sharp edge occurs where 
the function f has higher values than the constant c, the 
corresponding edge of the in gamut image g should be 
smaller, otherwise a halo artifact is produced. In order to 
reduce this second halo effect, the true gradient of f in the 
Sobolev term may be modified to reduce the gradient of g. 
This can be achieved, by computing a monotone increasing 
function J-S(f) such that the derivative of S is always less 
than unity for high values of /. As an example, the function 
f in the Sobolev term is replaced with a new function f : 



[0018] where y is a parameter greater than 1. The new 
function f has smaller derivatives at points where f is above 
C. The new functional is then: 



Jf (Ok * miflij. c) - k * g )) 2 dxdy + aj^ | V (**(/- g)f dxdy , 



[0019] subject to g(x,y)^min(c(x,y), /(x,y)). 

[0020] FIG. 1C shows the impact of replacing the func- 
tion f with the new function J. As can be seen, the step 
decrease behavior of g is now smaller than the behavior 
shown in FIG. 1A, thereby reducing the halo artifacts that 
otherwise would have been created at the image edge. 



Function g* illustrates the expected improvements when the 
first and second terms in equation (1) are corrected. 

[0021] FIG. 2 is a block diagram of an apparatus 10 that 
may be used for gamut mapping according to the functional 
of Equation (3). An image capture device 11 receives an 
input original image and produces an output image S 12, 
which is an electrical signal representing a calorimetric 
image value. For example, the capture device 11 may 
convert at least three calorimetric values of each pixel of the 
original image into corresponding electrical signals. The 
electrical signals may indicate the L, a, b values, for 
example. Other colorimetric values may be the XYZ tris- 
timilus value and the L, U, V or device dependent RGB 
values. A gamut mapper 15 produces an in-gamut image 
SI 6. Finally, a rendering module 17 provides a rendered 
image S"18. The rendering module 17 may be implemented 
as a color laser printer, for example. The thus-generated 
image S"18 may represent a best-fit image, given gamut 
limitations of the device in which the image reproduction is 
to occur. 

[0022] The image S 12 may represent the image as sensed 
by the capture module 11. The gamut mapper 15 applies an 
algorithm to extract and map the values of the image S 12 
into the gamut of the image reproduction device 17. In 
particular, the gamut mapper 15 may apply an algorithm that 
solves the problem represented by equation (3), thereby 
solving the gamut mapping problem and optimizing the 
output image S f, 18. 

[0023] FIG. 3 is a flowchart illustrating operation of an 
algorithm 100 used by the apparatus 10 to produce a 
rendered color image S"18 based on an original image S, 
given an image representation f and a gamut constraint c. 
The algorithm 100 begins operation in block 105. In block 
110, the function u=project c (/), where project c (/) is a pre- 
ferred projection method of f onto the general gamut volume 
C, is computed. Next, in block 115, the function f=(/) is 
computed. In certain color spaces, project c (;D is a minimum 
operation. Next, the function g(x,y) that minimizes the 
functional 



f <*.(«- g)) 2 dxdy + a[(V(k*(f- g))f dxdy , 

[0024] subject to g^u, is determined. The determination 
of g(x,y) according to the algorithm 100 may be completed 
by executing subroutine 125. 

[0025] Subroutine 125 comprises an initialization step: 
go-project c (/) (block 130), followed by iteration steps. In 
block 135, a gradient descent step computation determines 
a new function gj according to the Euler-Lagrange equation 
of equation (3): 

^,-i«(-**(«- Sl )+a**A(A*(r- gl ))), 
[0026] where x is a time step constant and A is the 
Laplacian operator. In block 140, a projection step 
g t -min(g t ,u) ensures that this function satisfies the gamut 
constraint. The subroutine 125 continues the gradient 
descent projection steps 135 and 140, respectively, until a 
stopping condition on g(x,y) is achieved in block 145. The 
optimum function g(x,y) is then the required projected 
image representation. In block 150, the operation of the 
algorithm 100 ends. 
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In the claims: 

1. A method for reducing halo artifacts during spatially 
dependent gamut mapping of a color image, comprising: 

computing a function u-project c (f), wherein f represents 
the color image, and C is a gamut volume; 

computing a monotone increasing function f=S(f) such 
that the derivative of S is less than unity for high values 
of /; and 

determining a function g(x,y) that minimizes the func- 
tional 



f *(u - g)) z dxdy + a f (V(ic*(/ - g ))f dxdy , 



subject to feC. 

2. The method of claim 1, wherein determining the 
function g(x,y), comprises: 

initializing go=project c (.f); and 

performing one or more iteration steps to compute g(x,y). 

3. The method of claim 2, wherein each of the one or more 
iteration steps comprises a gradient descent iteration accord- 
ing to: 

wherein x is a time step constant and A is a Laplacian 
operator; and 

projecting & onto the gamut volume C. 

4. A method for reducing halo artifacts during color image 
processing using a spatially dependent gamut mapping algo- 
rithm, comprising: 

first correcting a color distance term in the gamut map- 
ping algorithm; and 

second correcting a distance measure of an image gradient 
in the gamut mapping algorithm. 

5. The method of claim 4, wherein the first correcting step 
comprises computing a function u=project c (j% wherein f 
represents the color image and C is a gamut volume. 

6. The method of claim 4, wherein the second correcting 
step comprises computing a monotone increasing function 
J=S(.f) such that the derivative of S is less than unity for high 
values of f. 

7. The method of claim 4, further comprising determining 
a function g(x,y) that minimizes the functional 

f(k*(u-g)) 2 dxdy + a f [V{k*(f-g)fdxdy, 
Jn Jn 

subject to geC. 

8. The method of claim 7, wherein determining the 
function g(x,y), comprises: 

initializing go^ptojectj^f) and 

performing one or more iteration steps to compute g(x,y). 

9. The method of claim 8, wherein each of the one or more 
iteration steps comprises a gradient descent iteration. 



10. A computer readable medium comprising routines for 
reducing halo artifacts during color image processing using 
spatially dependent gamut mapping, the routines compris- 
ing: 

computing a function uoproject c ( i f), wherein f represents 
the color image, C is a target gamut, and c is a gamut 
constraint; 

computing a monotone increasing function JS(f) such 
that the derivative of S is less than unity for high values 
of /; and 

determining a function g(x,y) that minimizes the func- 
tional 



f {k*{u- g )) i dxdy^a[ (V{k*(f-g))) Z dxdy, 



subject to geC. 

11. The computer readable medium of claim 10, wherein 
determining the function g(x,y), comprises: 

initializing go-project c tf); and 

performing one or more iteration steps to compute g(x,y). 

12. The method of claim 11, wherein each of the one or 
more iteration steps comprises a gradient descent iteration 
according to: 

where x is a time step constant and A is a Laplacian 
operator; and 

projecting g t onto the target gamut C. 

13. An apparatus that reduces halo artifacts in an image 
rendered using spatially dependent gamut mapping models, 
comprising: 

an image capture device, wherein an original color image 
is received, and wherein the original image is repre- 
sented by a function f; 

a gamut mapper, wherein the received color image is 
transformed and projected onto a target gamut, the 
target gamut C having a constraint c, the gamut mapper 
comprising programming for: 

computing a function u«project c (j% 

computing a monotone increasing function J«S(J) such 
that the derivative of S is less than unity for higb 
values of f; and 

determining a function g(x,y) that minimizes the func- 
tional 



f (k*(u- g)f dxdy + af (V(k * (/ - g))f dxdy , 
Ja Jo 



subject to geC 

14. The apparatus of claim 13, wherein the gamut mapper 
further comprises programming for: 

initializing go~project c (;f); and 

performing one or more iteration steps to compute g(x,y). 
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15. The apparatus of claim 14, wherein each of the one or 
more iteration steps comprises a gradient descent iteration 
according to: 

««=s t -i«(-* 4 («-sO+^*A(**(f- 5t ))), 
wherein x is a time step constant and A is a Laplacian 
operator. 

16. The apparatus of claim 13, wherein the gamut mapper 
produces a projected image on the target gamut C. 

17. The apparatus of claim 16, further comprising a 
rendering device that transforms the projected image into a 
color space of the original image. 

18. An apparatus for reducing halo artifacts in a rendered 
color image, comprising: 

means for capturing an original color image, the original 
color image / having a defined color space; 

first means for transforming the original color image into 
a transform color space; 

means, coupled to the transforming means, for mapping 
the transformed color image onto a target gamut C, 
whereby a projected image is produced; 

second means, coupled to the mapping means, for trans- 
forming the projected image into the defined color 
space; and 

means for rendering the transformed projected image. 

19. The apparatus of claim 18, wherein the means for 
mapping comprises: 



means for computing a function u-project c (/); 

means for computing a monotone increasing function 
J=S(;f) such that the derivative of S is less than unity 
for high values of /; and 

means for determining a function g(x,y) that minimizes 
the functional 



f (k * (u - g )) 2 dxdy + a f (V (**(/- *))) 2 dxdy . 



subject to geC 

20. The apparatus of claim 18, wherein the mapping 
means further comprises: 

means for initializing go^project^/); and 

means for performing one or more iteration steps to 
compute g(x,y). 

21. The apparatus of claim 20, wherein each of the one or 
more iteration steps comprises a gradient descent iteration 
according to: 

w.-t«(-**(»-^+«**AC**ff-rf)). 
wherein x is a time step constant and A is a Laplacian 
operator; and 

projecting g t onto the target gamut C. 

***** 
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